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FOREWORD 

The  Operations  Research  Center  at  the  Massachusetts  Institute  of 
Technology  is  an  interdepartmental  activity  devoted  to  graduate  education 
and  research  in  the  field  of  operations  research.  The  work  of  the  Center 
is  supported,  in  part,  by  government  contracts  and  grants.  The  work  re- 
ported herein  was  supported  by  the  Office  of  Naval  Research  under  Contract 
N00014-75-C-0556. 

Richard  C.  Larson 

Jeremy  F . Shapiro 

Co-Directors 


Abstract 


The  multi-product  production  cycling  problem  is  concerned  with  the 
determination  of  a production/ inventory  policy  for  a single  capacitated 
production  facility  which  is  dedicated  to  producing  a family  of 
products.  In  an  earlier  paper,  heuristic  policies  were  proposed  for 
various  versions  of  the  multi-product  problem  This  paper  tests  the 
effectiveness  of  these  heuristics  by  simulation.  It  is  seen  that  the 
proposed  heuristic  utilizing  composite  products  and  the  lead-time 
adjustment,  is  the  most  effective  of  the  heuristics  considered  over 
the  set  of  test  problems  for  the  ldentical-x>roduct  problem.  Likewise, 
the  composite  product  heuristic  is  the  best  heuristic  for  the  identical- 
coat  problem  and  the  correlated  demand  problem. 
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1.  Introduction 

In  this  paper  the  multi-product  production  cycling  problem  (MPCP) 

Is  studied  by  means  of  simulation.  The  MPCP  Is  concerned  with  deter- 
mining production  and  Inventory  control  policies  for  a group  of  products, 
all  of  which  are  produced  on  a single  production  facility.  An  earlier 
paper  [ 3]  has  addressed  this  problem  and  has  proposed  heuristic  decision 
policies  for  two  special  classes  of  the  MPCP:  the  Identical-product 
problem,  and  the  Identical-cost  problem.  This  paper  extends  the  previous 
work  by  testing  the  proposed  heuristics  by  means  of  simulation. 

The  paper  Is  organized  as  follows:  In  section  2 the  simulation 
program  Is  described  In  general.  In  section  3 the  simulation  Is  used 
to  test  the  effectiveness  of  the  proposed  heuristics  for  the  Identical- 
product  problem.  This  set  of  heuristics  Is  compared  against  some 
alternative  heuristics  which  are  proposed  In  this  section.  Sections  4 
and  5 consider  the  Identical-cost  problem  and  the  correlated-demand 
problem,  respectively.  In  both  Instances,  the  simulation  Is  used  to 
compare  the  proposed  composite-product  heuristic  against  a set  of 
alternative  heuristics.  The  last  section  vlvts  a summary  of  the  results. 
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2.  Description  of  Simulation 

A computer  program  has  been  developed  to  simulate  a multi-product 
single-machine  system.  This  simulation  program  Is  characterized  by  the 
following  set  of  specifications  for  an  n-product  problem: 

1.  Demand  for  each  product  Is  an  Independent  Poisson  proc'^ss  where 
Is  the  demand  rate  for  product  1,  l~l,2,...,n. 

2.  The  production  rate  for  each  product  Is  one  unit  per  period.  This 

n 

Implies  that  expected  machine  utilization  Is  U • I A . . 

1-1  ^ 

3.  Inventory  holding  and  backorder  costs  are  linear  with  respect  to  the 
net  Inventory  level  at  the  end  of  the  period. 

4.  All  products  have  identical  cost  structures.  In  particular,  the 
Inventory  holding  cost  rate  Is  1 cost  unit  per  unit  of  Inventory 
per  period,  while  the  backorder  cost  rate  Is  5 cost  units  per 
backorder  per  period.  The  setup  cost  K Is  an  Input  parameter. 

5.  The  production  lead  time  Is  ten  periods. 

6.  All  simulation  runs  are  for  20,200  periods.  The  first  200  periods 
are  used  to  Initialize  the  system.  System  costs  are  accumulated 
over  the  remaining  20,000  periods. 

Given  this  description  of  the  simulation,  a test  problem  Is  specified 
by  setting  the  number  of  products  n,  the  demand  rates  for  the  products 
(A^) , and  the  setup  cost  K.  To  run  the  simulation,  a heuristic  policy 
must  be  specified  for  making  production  decisions.  Tor  each  test 
problem,  the  generated  demand  realization  Is  Identical  for  every  heuristic 
that  Is  considered  for  that  test  problem.  Hence,  any  variation  among 
the  performances  of  the  heuristics  on  the  test  problem  Is  due  to  the 
heuristics,  and  Is  not  a consequence  of  differences  In  the  generated 
demand.  At  the  start  of  the  simulation,  each  product  Is  given  an  Initial 
Inventory  of  three  times  the  product's  economic  order  quantity. 


J 
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3.  The  Identical-Product  Problem 

The  identical-product  problem  was  defined  and  analyzed  in  [ 3 ]; 
essentially,  for  this  problem,  all  products  have  Identical  costs.  Iden- 
tical production  rates,  and  Identical,  but  Independent,  demand  distri- 
butions. In  [ 3 ],  a heuristic  decision  procedure  was  developed  which 
relied  on  the  Individual  one-product  analysis,  the  notion  of  composite 
products  and  the  lead-time  adjustment.  To  test  the  effectiveness  of 
this  heuristic  and  Its  components,  the  following  five  heuristics  are 
defined. 

HI:  The  heuristic  HI  Is  the  decision  procedure  relying  solely  on 
the  one-product  analysis  of  the  Indvldual  Identical  products. 

Each  product  is  governed  by  a two-crltical-number  policy 

* ** 

(1,1  ) . A product  has  triggered  whenever  It  was  produced 

In  the  previous  period  and  Its  inventory  Is  currently  less  than 

** 

I , or  It  was  not  produced  In  the  previous  period  and  Its 

■k 

Inventory  Is  noi/  below  1 . If  no  products  trigger,  then  the 
machine  Is  Idle  In  the  current  period,  while  If  exactly  one 
product  triggers,  then  that  product  Is  produced.  If  more  than 
one  product  triggers,  then  the  product  to  produce  Is  found  by 
comparing  value  functions,  as  pr<'posed  In  [ 3 ]. 

H2:  The  heuristic  H2  extends  HI  by  using  composite  products  (as 
developed  in  [ 3 ])  In  the  decision  procedure.  Again,  value 
functions  are  used  to  resolve  conflicts  when  more  than  one 
product,  or  more  than  one  composite  product,  triggers  In  a 
period. 

H3:  The  heuristic  H3  adds  the  lead-time  adjustment  [ 3 ] to  H2. 


H4:  Heuristic  H4  Is  Identical  to  H2  except  that  the  comparison  of 
relative  Inventory  levels  [ 3 ] rather  than  value  functions  Is 
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used  to  resolve  conflicts  when  more  than  one  product  triggers. 

H5:  Heuristic  H5  Is  Identical  to  H3  except  that  relative  Inventory 
levels  rather  than  value  functions  are  compared  to  resolve 
conflicts. 

These  five  heuristics  were  selected  so  that  both  the  effectiveness 
of  the  coo^oslte  product  (HI  vs.  H2  or  HI  vs.  H4) , and  the  Incremental 
effectiveness  of  the  lead-time  adjustment  (H2  vs.  H3  or  H4  vs.  H5)  could 
be  studied.  In  addition,  we  can  contrast  the  comparison  of  value  functions 
against  the  use  of  relative  Inventory  levels.  To  test  the  effectiveness 
of  these  heuristics  compared  with  possible  alternative  heuristic  policies, 
three  additional  heuristics  have  oeen  defined. 

H6:  The  heuristic  H6  Is  characterized  by  two  parameters  (1*,N  ). 

Whenever  a product  Is  chosen  to  be  produced.  It  will  be  produced 
for  N*  consecutive  periods,  regardless  of  anything  else.  After 
N periods  of  production,  a decision  Is  made  either  to  shut- 
I down  the  facility  or  begin  production  on  the  least-inventory 

^ product.  The  decision  will  be  to  shutdown  If  the  least- 

) ic 

; Inventory  product  has  Inventory  greater  than  I ; otherwise, 

! 

i the  decision  ii?  to  produce  t'^e  :;.,r..cr.t  least-inventory  product 

* 

for  N periods. 

A ^ 

H7:  The  heuristic  H7  parameterized  by  (I  ,I  ).  The  product 

currently  setup  on  the  machine  will  continue  to  be  produced 

** 

until  Its  Inventory  reaches  or  exceeds  I • At  that  time, 
the  machine  Is  shutdown  only  If  the  product  with  least 

It 

Inventory  has  Inventory  greater  than  I ; if  not,  then  the 
least- inventory  product  is  setup. 

* 

H8:  The  heuristic  H8  Is  parameterized  by  (I  ,I  ).  It  Is  Identical 
to  H7  except  In  that  It  allows  for  the  machine  to  be  switched 

l 
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from  one  product  to  another  product  prior  to  the  first  product's 

** 

inventory  having  reached  I . Let  1^^  and  I2  be  the  inventory 
levels  of  the  product  with  least  Inventory,  and  of  the 
product  being  produced,  respectively.  Then  this  heuristic 

will  switch  to  the  least-inventory  product  whenever 

* ** 

I - > I - I2. 

These  three  heuristics  are  based  on  standard  notions  of  inventory 
theory.  The  first  heuristic  H6  corresponds  to  a (Q,R)  policy.  Orders 
are  triggered  when  inventory  drops  below  a reorder  point  (R  or  I*); 

"k 

the  order  size  is  fixed  equal  to  Q units  or  N periods  of  production. 

The  second  heuristic  H7  represents  an  (s,S)  policy.  Again  there  is 

a reorder  point  (I*  or  s) , but  now  the  order  quantity  is  such  to  bring 

, ** 

inventory  up  to  some  predetermined  level  (I  or  S) . Heuristic  H8  is 
a modification  of  H7  which  allows  for  switching  of  products  prior  to 
the  setup  product  reaching  the  order-up-to  level  (I  ) . 

No  theory  exists  concerning  how  to  choose  the  parameters  for  these 
three  heuristics.  The  Inventory  theory  developed  to  find  (Q,R)  or 
(s,S)  policies  is  not  useful  since  that  theory  -s  restricted  to  single- 
product uncapacitated  problems.  Therefore,  for  each  of  the  three 
heuristics  H6,  H7,  and  H8,  to  estimate  the  best  set  of  parameters,  a 
grid  search  is  done  over  a restricted  policy  space.  To  determine  the 
expected  cost  for  ecch  policy  in  the  grid,  the  system  is  simulated  for 
600  periods  where  the  first  100  periods  are  for  the  Initialization, 

while  costs  are  recorded  only  over  the  last  500  periods.  The  policy 

* 

with  least  cost  is  then  chosen  to  be  the  best  choice  of  parameters. 


An  examination  was  made  of  the  sensitivity  of  this  search  procedure 
to  the  length  of  the  simulation  run;  a run  size  of  600  periods  was 
found  to  be  sufficient  for  finding  an  optimal  or  near-optimal 
parameter  choice. 


I 
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These  eight  heuristics  are  compared  on  eighteen  identical-product 
problems.  These  test  problems  vary  with  respect  to  the  number  of  products, 
the  machine  utilization  eind  the  setup  cost.  The  number  of  products  n 
ranges  over  three  values:  n=2,  n=5,  or  n=10.  Machine  utilization  U also 
takes  on  three  values:  U = 70%,  U = 90%,  or  U = 95%.  The  setup  cost  may 

be  either  "high"  or  "low".  The  high  setup  cost  is  set  so  that  the 

economic  order  quantity  (EOQ)  for  an  individual  product  is  equal  to 
five  periods  of  production  (since  the  production  rate  is  one  for  all 
test  problems,  this  is  EOQ  =5);  the  low  setup  cost  is  such  that  the 
individual  product's  EOQ  is  two  units.  By  taking  all  possible  comblna-  j 

I 

1 

tlons,  eighteen  test  problems  are  constructed  with  each  test  problem  ^ 

being  specified  by  the  triplet  n/U/EOQ. 

For  the  test  problems  with  n=2  and  n=5,  the  production  lead  time 
is  ten  periods.  For  n=10,  the  lead  time  is  set  to  twenty  periods;  it 

was  observed  that  for  n=10  there  is  not  sufficient  demand  variation 

over  a lead  time  of  ten  periods  to  allow  for  the  heuristics  to  delineate 
themselves. 

The  results  from  the  simulation  for  the  eighteen  test  problems  are 
given  in  Figure  1.  Each  entry  in  the  figure  is  the  observed  average 
total  cost  per  period  for  a given  test  problem  using  a glvon  heuristic 
scheduling  procedure.  In  studying  this  figure,  the  following  observa- 
tions may  be  made  on  the  relative  performances  of  the  heuristics  tested: 

1.  Heuristic  H2,  which  uses  the  composite  product  seems  to  be  an 

Improvement  over  HI.  This  is  especially  true  at  the  higher  machine 
utilization  levels  (l.e.  U * 90,  95)  where  H2  dominates  HI.  At  low 
machine  utilizatlcn  (U“70),  however,  the  benefit  of  the  composite 
product  is  not  clearcut.  It  is  unclear  why  the  composite  product 
may  be  counter-productive  in  these  Instances.  Since  the  composite 

i 
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Heuristic  Procedure 


HI 

H2 

H3 

H4 

H5 

H6 

H7 

2/70/2 

8.06 

7.93* 

7.93* 

8.09 

7.93* 

9.51 

8.69 

2/70/5 

11.01 

11.00 

10.93* 

11.18 

11.09 

14.98 

11.39 

2/90/2 

13.52 

11.21 

11.05* 

11.14 

11.17 

15.69 

15.54 

2/90/5 

16.37 

14.17 

13.97 

13.78 

13.70* 

21.57 

17.44 

2/95/2 

26.77 

16.68 

16.43 

16.66 

16.42* 

27.47 

27.41 

2/95/5 

26.44 

18.17 

18.73 

17.89* 

17.89* 

26.60 

26.99 

5/70/2 

14.63 

14.56 

14.63 

14.55* 

14.55* 

16.28 

15.75 

5/70/5 

25.59* 

25.89 

25.86 

25.89 

25.72 

26.25 

26.00 

5/90/2 

20.71 

17.93 

17.12 

17.79 

17.08* 

19.05 

19.52 

5/90/5 

33.62 

28.59 

27.72 

27.99 

27.30* 

30.02 

29.64 

5/95/2 

30.13 

19.80 

19.57 

19.94 

19.26* 

20.30 

24.39 

5/95/5 

35.33 

29.68 

29.64 

29.80 

28.84* 

31.32 

33.09 

10/70/2 

29.18* 

29.19 

29.21 

29.53 

29.53 

29.64 

31.19 

10/70/5 

52.20* 

53.91 

54.12 

54.26 

54.26 

53.40 

52.74 

10/90/2 

38.64 

36.00 

32.99* 

36.14 

33.35 

34.51 

35.45 

10/90/5 

62.96 

57.17 

56.78 

57.47 

55.93 

56.67 

57.81 

10/95/2 

51.94 

40.82 

41.34 

39.05 

38.95* 

49.74 

39.79 

10/95/5 

64.08 

60.24 

62.93 

61.53 

57.21* 

64.58 

80.62 

8.13 

11.07 

13.49 

13.77 

17.91 

22.68 

14.63 

25.63 

17.16 
27.98 
19.76 
50.04 

30.16 
54.81 
33.90 
55.73* 
41.80 
57.96 


Figure  1;  Simulation  Results  for  Identical-Product  Problem 


product  heuristic  will  not  overproduce,  it  seems  that  the  only  explanation 
for  the  observed  behavior  at  low  utilization  is  that  the  composite  product 
heuristic  occasionally  chooses  the  wrong  product  to  produce.  For  Instance, 
H2  might  continue  to  product  the  currently-setup  product,  which  in  fact  it 
should  switch  to  the  least-inventory  product.  Otherwise,  the  composite 
* 

Indicates  best  performing  heuristic  for  test  problem. 
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: i 

! product  appears  to  be  very  beneficial. 

2.  The  heuristic  H3,  which  Incorporates  the  lead-time  adjustment  into 

its  analysis,  performs  slightly  better  than  H2,  though  H3  does  not 
dominate  H2.  Hence,  here  the  usefulness  of  the  lead-time  adjustment 

' is  unclear. 

3.  It  is  difficult  to  distinguish  between  the  overall  performance  of  H2 

versus  H4.  On  this  basis  no  conclusions  may  be  made  on  the  merit 

i of  the  value  function  o/er  relative  Inventory  levels. 

4.  The  performance  of  H5  seems  to  dominate  that  of  the  other  heuristics. 

This  heuristic  is  the  best  in  eleven  out  of  eighteen  problems  while 
performing  close  to  best  in  the  remaining  seven  problems.  In 
particular,  H5  performs  best  in  all  six  problems  with  highest 
machine  utilization  (U  = 95) . These  high  utilization  problems 
are  t)rpically  the  most  difficult  to  schedule  due  to  the  reduction 
in  flexibility  caused  by  the  tight  capacity  constraint.  Consequently, 
these  problems  are  the  most  sensitive  to  the  scheduling  policy 
used,  and  should  exhibit  the  largest  reward  from  Improvements  in 
the  scheduling  policy. 

5.  The  alternative  heuristics  H6,  H7,  and  H8  were  p;.*oposed  as  reason- 
able heuristics  derived  from  traditional  practices  in  inventory 
theory.  The  performances  of  H6  and  H7  are  by  far  the  worst  of  any 
of  the  heuristics.  H8  performs  reasonably  well,  but  is  outper- 
formed by  H5.  Note  again  for  these  three  heuristics,  there  is  no 
theory  on  determining  their  policy  parameters;  rather,  this  must 
be  done  by  means  of  a simulation  search  procedure. 

To  support  ti'.e  above  observations,  statistical  tests  have  been 


perfrrmed  on  the  data  in  Figure  1.  To  test  the  null  hypothesis  that  the 
eight  heuristic  policies  are  Indistinguishable,  a two-way  analysis  of 
variance  is  done;  using  an  F-statlstic  the  null  hypothesis  may  be 


-9- 

rejected  at  a significance  level  of  .005.  To  test  the  dominance  of  HS, 
pairwise  comparisons  are  made  between  H5  and  each  of  the  other  heuristics. 

To  test  the  null  hypothesis  that  there  is  no  difference  between 
H5  and  another  heuristic,  against  the  alternative  heuristic  that  H5 
performs  better,  a one-tailed  test  is  made  using  a student's  t statistic; 
the  student's  t statistic  is  formed  from  the  differences  between  H5 
and  the  other  heuristic  on  the  eighteen  test  problems.  The  results  of 
these  tests  are  presented  in  Figure  2.  Clearly,  in  all  instances,  the 
null  hypothesis  may  be  rejected,  and  thus  the  heuristic  H5  is  significantly 
better  than  each  of  the  other  heuristics.  Note  that  for  H3,  though,  the 
significance  level  is  only  .10;  this  is  to  be  expected  since  H3  and  H5 
art  nearly  identical,  differing  only  in  the  use  by  H3  of  the  value  function. 


heuristic 

It 

t-statistic 

significance 

level 

HI 

3.01 

.005 

H2 

2.49 

.025 

H3 

1.64 

.100 

H4 

2.19 

.025 

HS 

- 

- 

H6 

2.98 

.005 

H7 

2.46 

.025 

H8 

2.47 

.025 

Figure  2:  Pairwise  Comparison  of  Heuristics  with  H5 

In  addition  to  these  tests,  nonparametric  tests  were  applied  to  the 
data  in  Figure  1 to  test  the  same  hypotheses.  These  tests  are  appropriate 
if  the  normality  assumptions  necessary  for  the  F-statlstlc  and  the 
t-statlstics  are  violated.  To  test  whether  the  heuristics  are  different, 
a Friedman  two-way  analysis  of  variance  by  ranks  is  used  (see  [4  ]).  To 
* 

All  t-Btatistics  have  m-1  - 17  degrees  of  freedom. 


L ^ 
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determlne  If  H5  Is  the  best  heuristic,  again  pairwise  comparisons  are 
made  with  each  other  heuristic.  Here,  the  Wllcoxon  matched-pairs 
signed-ranks  test  is  used  (see  [ 4]).  The  results  of  these  non- 
parametrlc  tests  are  consistent  with  those  for  the  parametric  tests; 

In  fact,  the  non-parametrlc  results  have  higher  significance  levels. 
Details  of  the  application  of  these  tests  are  given  In  [2  ]. 

Thus,  It  has  been  shown  that 

1.  The  eight  heuristics  perform  differently  over  the  eighteen  test 
problems; 

2.  Heuristic  H5  outperforms  the  other  heuristics  based  on  a pairwise 
comparison  of  H5  with  each  of  the  other  heuristics. 

Note  that  H5  uses  both  composite  products  2ind  the  lead-time  adjustment; 
hence,  these  notions  appear  helpful  In  scheduling  the  multi-product 
problem.  However,  H5  does  not  use  the  value  function  to  distinguish 
between  triggered  products;  rather,  it  simply  uses  differences  in  inven- 
tory levels.  Thus  for  the  multi-product  problem,  the  value  function 
from  the  one-product  analysis  does  not  accurately  reflect  the  value  of 
the  machine  to  a particular  product,  and  its  use  can  be  outperformed 
by  simply  comparing  inventory  levels.  Note,  however,  that  whereas  H5 
is  an  improvement  over  H3,  H4  performs  slightly  worse  than  H2.  Since 
H3  (H5)  differs  from  H2  (H4)  only  in  the  use  of  the  lead-time  adjust- 
ment, it  seems  that  the  merit  of  the  value  function  may  depend  on  the 
other  compo::ents  in  the  heuristic  policy. 
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4.  The  Identical-Cost  Problem 

The  Identical-cost  problem  assumes  that  all  products  have  the  same 
j cost  structure  and  the  same  production  rate;  however,  the  demand  rates 

may  vary  across  products.  In  [ 3]  it  is  shown  how  heuristics  HI  and  H2, 
which  were  originally  proposed  for  the  identical-product  problem,  may 
be  extended  to  the  identical-cost  problem.  In  this  section,  three 
additional  heuristics  are  proposed  for  the  identical-cost  problem. 

These  five  heuristics  are  then  simulated  on  four  test  problems  to  deter- 
f mine  the  best  heuristic  for  this  problem. 

Heuristic  HI  relies  entirely  on  the  one-product  analysis  of  the 
individual  products.  Heuristic  H2  improves  HI  by  introducing  the  use 
of  composite  products.  Note  that  the  lead-time  adjustment  cannot  be 

i 1 

I applied  to  the  identical-cost  problem.  In  addition  to  these  two 

\ 1 

heuristics,  heuristics  H6,  H7,  and  H8  from  the  previous  section  may  be 

modified  for  the  identical-cost  problem.  The  modification  is  a ; 

rescaling  of  inventory  for  declsj.on  purposes.  For  the  identical-product 
problem,  for  each  of  these  three  heuristics,  decisions  are  made  by  comparing 
: inventory  levels  to  the  policy  parsimeters  of  the  heuristic.  To  incle- 

ment these  heuristics  for  the  identical-cost  problem,  comparisons  are 
made  with  respect  to  periods-of-supply  rather  than  with  inventory  levels. 

The  periods-of-supply  for  a product  is  the  inventory  level  divided  by 
the  demand  rate  per  period.  By  dividing  by  the  demand  rate,  this  modification 
[ allows  for  comparisons  across  products  of  differing  demand  rates.  Again, 

the  parameters  for  these  heuristics  must  be  determined  by  a simulation 
search. 

These  five  heuristics  are  tested  on  four  identical-cost  problems. 

Each  of  the  four  test  problems  has  five  products  and  demand  for  each 
product  i is  Poisson  with  rate  A^.  The  machine  utilization  is  90X  for 
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each  problem.  The  four  test  problems  are  as  follows: 


a)  Aj 

b)  Aj 

c)  Aj 

d)  A, 


A^  = .1,  Aj  ■ .5;  EOQ  - 2. 

A^  “ .1,  Aj  “ .5;  EOQ  = 5. 

.1,  A^  = Aj  - .3;  EOQ  = 2. 

.1,  A^  = Aj  - .3;  EOQ  = 5. 


Thus  the  problems  are  characterized  by  the  demand  rates  for  the  five 
products,  and  by  the  setup  cost.  The  setup  cost  Is  set  to  obtain  the 
chosen  economic  order  quantity  (EOQ)  for  the  product  with  the  smallest 
demand  rate  (l.e.  A^  = .1). 

The  results  from  the  simulation  of  the  test  problems  are  given  In 
Figure  3.  In  comparing  HI  with  H2,  It  Is  clear  here  that  the  Introduc- 
tion of  the  composite  product  In  H2  provides  a substantial  Inr^^rovement. 
Heuristics  H6  and  H7,  the  analogs  to  Inventory  theory's  (Q,R)  and  (s,S) 
policies  respectively,  have  performances  comparable  to  HI  but  are  out- 
performed by  H2.  The  heuristics  H8,  however,  compares  well  with  heuristic 
H2.  Heuristic  H2  performs  best  In  three  of  the  test  problems  while  H8 
Is  slightly  better  In  test  problem  b. 

heuristic 


problem 

HI 

H2 

H6 

H7 

H8 

a 

22.50 

17.41* 

20.72 

20.56 

18.26 

b 

28.91 

26.31 

28.92 

30.18 

26.14* 

c 

22.93 

18.58* 

20.64 

21.51 

19.32 

d 

29.54 

28.51* 

29.54 

31.59 

29.16 

Figure  3:  Simulation  Results  for  Idar.tlcal-Cost  Problem 
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To  verify  these  observations,  a set  of  statistical  tests  has  been 
constructed  from  the  simulation  runs.  For  each  of  the  simulation  runs, 
costs  are  accumulated  over  20,000  periods.  By  breaking  the  simulation 
run  Into  100  blocks  of  200  periods  each,  a sample  of  100  cost  observa- 
tions Is  obtained;  each  cost  observation  corresponds  to  the  average 
cost  for  a heuristic  on  a test  problem  over  a block  of  200  periods. 

Mote  that  the  sanq^le  points  for  a heuristic  are  not  totally  Independent 
since  the  costs  Incurred  In  one  period  are  dependent  on  the  costs  Incurred 
In  the  previous  period.  This  dependency  between  sample  points  will 
grow  smaller  as  the  size  of  the  blocks  Increases.  From  observation 
of  the  behavior  of  the  sample  points,  a block  size  of  200  periods  Is 
sufficient  to  reduce  the  dependency  to  a point  where  It  can  be  safely 
Ignored.  In  this  manner,  100  cost  sample  points  are  obtained  for  each 
heuristic  for  each  problem. 

To  test  the  null  hypothesis  that  two  heuristics  are  equivalent  for 
a specific  test  problem,  a student's  c-statlstlc  can  be  formed  from 
the  differences  between  the  two  matched  cost  samples.  Figure  A reports 
these  t-statlstlcs  when  the  four  heuristics  HI,  H6,  H7,  and  H8  are 


heuristic 


test  problem 

HI 

H6 

H7 

H8 

a 

6.49 

6.44 

5.82 

4.14 

b 

4.03 

6.08 

7.08 

-0.35 

c 

6.27 

6.50 

5.42 

1.18 

d 

2.18 

2.65 

5.04 

1.47 

* 

Figure  4:  t-tests  for  Heuristics  Compared  Against  H2  for 
Identical-Cost  Problem 


* 


L 


All  t-values  are  with  99  degrees  of  freedom. 
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conpared  Individually  against  H2,  the  composite  product  heuristic. 

The  difference  between  H2  and  HI,  H6,  and  H7  Is  highly  significant 
for  each  of  the  test  problems;  the  significance  level  Is  less  than  .001 
for  each  Instance,  except  for  problem  d where  the  significance  level  Is 
.025  for  HI  and  .005  for  H6.  Hence  the  null  hypothesis  that  H2  Is 
equivalent  to  any  of  these  three  heuristics  can  be  rejected.  In 
comparing  H2  with  H8,  H2  clearly  outperforms  H8  only  for  problem  a. 

For  the  other  three  test  problems,  the  null  hypothesis  cannot  be  rejected 
with  95Z  confidence.  Note,  however,  that  despite  the  lack  of  statistical 
significance,  H2  seems  to  perform  better  than  H8.  The  differences  between 
H2  and  H8  on  the  three  test  problems  for  which  H2  Is  best  are  greater 
and  more  significant  than  the  difference  between  the  two  heuristics  for 
problem  b.  Hence,  based  on  this  limited  evidence  the  composite  product 
heuristic  seems  to  be  the  most  effective  procedure  for  the  Identical-cost 
problem. 
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I 5.  The  Correlated-Demand  Problem 

{ For  the  identical-product  problem  and  the  identical-coat  problem, 

I it  is  aasumed  that  demand  across  products  is  Independent.  In  this 

i 

i section  the  correlated-demand  problem  assuming  identical  products  is 

t 

examined.  Five  heuristics  are  proposed  for  the  correlated-demand 
problem,  and  are  tested  by  simulation  on  six  test  problems. 

The  five  heuristics  to  be  tested  are  HI,  H2,  H6,  H7,  and  H8.  In 
[ 3 ] it  is  shown  how  the  composite-product  heuristic  H2  can  be  used 
for  the  correlated-demand  problem.  Heuristic  HI  which  only  uses  the 
analysis  of  single  products  is  not  altered  when  applied  to  the 
correlated-demand  problem.  Assuming  identical  products,  H6,  H7,  and  H8 
are  not  altered  in  form  at  all  for  the  correlated-demand  problem.  It 
is  expected  that  the  effect  of  the  demand  correlation  on  the  heuristics 
H6,  H7,  and  H8  will  be  reflected  in  parameter  choices  yielding  higher 
safety  stock  levels  for  increasing  positive  correlation. 

These  five  heuristics  are  tested  on  a set  of  six  problems.  Each 
of  the  problems  assumes  two  Identical  products  with  machine  utilization 
of  90Z.  Demand  is  assumed  to  be  a bivariate  Poisson  process  with  a 
correlation  coefficient  of  p where  |p|  ^1  (see  [1]).  A test  problem 
is  characterized  by  specifying  a value  for  p and  the  setup  cost.  The 
setup  cost  is  set  so  that  each  individual  product  has  an  EOQ  equal  to 
2 or  5 units.  The  correlation  coefficient  p is  set  to  0,  .33,  or  .66. 
This  results  in  six  test  problems.  A test  problem  is  denoted  by  the 

I pair  p/EOQ.  Note  that  p-O/EOQ-2  and  P"0/EOQ“5  are  identical  to  problems 

j 2/90/2  and  2/90/5,  respectively,  in  Figure  1. 

I The  simulation  results  for  the  test  problems  are  presented  in 


Figure  5.  Heuristic  H2,  utilizing  the  composite  product,  is  a dramatic 
improvement  over  HI.  Indeed,  the  magnitude  of  the  benefit  from  the 
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conposlte  product  Increases  as  the  demand  correlation  Increases. 
Alternative  heuristics  U6  and  H7,  again,  do  not  perform  well  with 
respect  to  H2.  Heuristic  H8  does  better  than  H2  In  two  of  the  six  test 
problems;  however,  for  one  of  these  problems  (p“0/EOQ»5) , the  coiig>oslte- 
product  heuristic  will  perform  better  than  H8  by  modifying  H2  to  Include 
a lead-time  adjustment  (see  Figure  1).  Thus,  over  the  six  test  problems, 
the  composite-product  heuristic  H2  seems  best. 


heuristic 


test  problem 

HI 

H2 

H6 

H8 

p»0/EOQ=2** 

13.52 

11.21 

15.69 

13.49 

p».33/E0Q=2 

17.37 

12.77* 

14.37 

13.74 

P».66/E0Q=2 

20.91 

14.18 

15.50 

14.07* 

p*0/E0Q=5** 

16.37 

14.17 

21.57 

13.77 

p».33/E0Q=5 

2C.17 

15.10* 

19.75 

19.25 

15.77 

p=.66/E0Q=S 

23.64 

16.21* 

19.15 

20.29 

16.58 

Figure  5:  Simulation  Results  for  Correlated-Oemand  Problem 

To  test  for  the  dominance  of  H2,  a statistical  analysis  similar  to 
that  for  the  Identical-cost  problem  has  been  done.  For  each  test  problem 
the  heuristic  H2  Is  conqpared  with  each  of  the  alternative  heuristics  by 
means  of  a student's  t--test.  Figure  6 gives  the  t-values  for  this 
analysis.  In  comparing  H2  with  either  HI,  H6,  or  H7,  the  null  hypo- 
thesis that  the  pair  of  heuristics  are  Identical  Is  easily  rejected 
for  all  test  problems.  However,  when  comparing  H2  with  H8,  there  Is 
no  simple  conclusion  on  the  relative  performance  of  the  two  heuristics. 

In  testing  the  null  hypothesis  that  the  two  heuristics  are  Identical 
against  the  alternative  hypothesis  that  H2  outperforms  H8,  the  null 
* 

Best  performance  for  test  problem. 

Best  performance  for  test  problem  was  with  heuristics  using  lead-time 
adjustments;  see  Figure  1. 
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hypochesls  can  be  rejected  with  95Z  confidence  for  three  of  the  test 
problems  and  with  90%  confidence  for  four  of  the  test  problems.  In 
I addition,  for  the  one  problem  (P^O/EOQ-5)  for  which  H8  Is  significantly 

I better  than  H2,  we  know  that  by  using  the  lead-time  adjustment,  the 

composite-product  heuristic  will  perform  as  well  as  H8.  Hence,  even 
though  the  evidence  presented  Is  not  conclusive,  the  heuristic  H2 
appears  to  be  the  best  heuristic  over  a reasonable  ran^e  of  problems. 
Note  that  the  relative  performance  of  H2  does  not  seem  to  be  sensitive 

i 

to  the  level  of  demand  correlation  as  measured  by  p. 


heuristic 


test  problem 

HI 

H6 

H7 

H8 

P-0/EOQ=2 

6.13 

6.30 

4.88 

p-.33/EOQ=2 

3.20 

4.79 

2.18 

p-.66/E0Q=2 

2.84 

5.86 

-0.75 

p»0/E0Q=5 

7.32 

5.26 

-2.24 

p«.33/EOQ=5 

4.97 

5.71 

5.10 

1.58 

p-.66/E0Q=5 

5.34 

6.62 

6.31 

1.69 

Figure  6:  t-tests  for  Heuristics  Compared  Against  H2  for  Correlated- 
Demand  Problem 


All  t-values  are  with  99  degrees  of  freedom. 
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6.  Suninary 

In  this  paper  the  multi-product  production  cycling  problem  has  been 
studied  by  means  of  simulation*  Three  classes  of  problems  have 
been  considered,  and  for  each  class,  heuristic  decision  procedures,  that 
were  proposed  In  [ 3 ] , were  tested  by  simulation. 

The  simplest  multi-product  problem  considered  was  the  Identical- 
product  problem.  For  this  problem  It  was  shown  that  a heuristic  which 
Incorporated  both  the  notion  of  coiiq>oslte  products  and  the  lead-time 
adjustment,  was  the  most  effective  heuristic  that  was  considered  over 
a wide  range  of  test  problems. 

The  Identical-cost  problem  represented  an  attempt  to  model  the 
general  multi-product  problem.  It  was  argued  in  [ 3 ] that  If  a 
multi-product  scheduling  problem  exists.  It  can  often  be  formulated  as 
an  Identical-cost  problem.  For  this  problem,  the  conqiosite-ui'oduct 
heuristic  performed  best.  It  Is  believed  that  Improvements  In  this 
composite-product  heuristic  could  be  made  by  Incorporating  a lead-time 
adjustment.  Unfortunately,  though,  theory  for  such  a lead-time 
adjustment  for  the  identical-cost  problem  has  not  been  developed. 

The  correlated-demand  problem  was  a natural  extension  to  the 
original  Identical-product  problem.  Here  a simple  two-product  version 
of  the  problem  with  bivariate  Poisson  demand  was  considered.  The 
conclusions  for  thix  problem  are  similar  to  those  for  the  Identical- 
cost  problem.  The  composite  product  Is  very  useful  In  scheduling  the 
problem;  the  heuristic  which  utilizes  composite  products  was  shown  to 
be  the  best  heuristic.  Again,  this  composite-product  heuristic  would 
likely  be  Improved  If  a suitable  lead-time  adjustment  could  be  found  for 
the  correlated-demand  problem. 
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